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ABSTRACT 

The current interest in an educational technology 
that stresses adaptation to individual student differences has 
resulted in such individualized systeas as Individually Prescribed 
Instruction (IPI) and Coaputer Assisted Instruction (CAiy • However, 
such systems are not the answer to an avoidance of standardization of 
students. No one has yet resolved the basic dilemma between the cost 
in time-and-effort efficiency and the demands of test theory for 
validity and reliability of tests* This dilemma means that while good 
teaching items should have a low error factor in order to elicit the 
correct response and then reinforce it, good diagnostic items (needed 
for individualization) should not have a low error factor* Thus, good 
teaching items meet criteria incompatible with those met by good 
diagnostic items* This problem is not insurmountable, but none of the 
existing programs of individualized instruction have solved it. The 
most persuasive point against the existing programs is that they are 
individualized only in terms of what the student brings to the 
lesson; they still result in the production of uniformity. (MH) 
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Today there ie a great deal of interest in an educational 

% 

technology which atroases adaptation to individual differences. It 
is feared that programniing and the increaoed processing of mass®/^ 
in the name of education will obliterate all divergence and indivi- 
duality by making the student a mere replica of the standard student 

N 

defined in our behavioral objectives. Emphasis on systems, such as 

Individually Prescribed Instruction or Computer Assisted Instruction, 

that adapt to differences is often taken as an answer to this problem. 

I suggest that it is not an answer. The fear of deadly uniformity 

is as great with so-called individualised instruction as without it. 

To adjust to individual differences in most IPI and CAI systems, 

» 

continual small modifications of teaching-sequence are made as the 
result of repeated measures of individual differences. And, although 
this procedure is taken as “obviously" worthy, I suggest on the one 
band, that there are little compelling data to support its "obvious" 
merit and on the other, that no one, as yet, has resolved a basic 
dilemma between the cost in efficiency (in terms of time and effort) 
and the demands of test theory for validity and reliability of tests. 

First consider the question of cost efficiency versus reliability 
of testing* While the rationale for the design of teaching and test- 
ing items in IPI and CAI is not often clearly stated and perhaps not 
universally agreed upon, it seems that generally the rationale for 
teaching sequences draws directly on that of programmed Instruction. 

j 
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For oxampla, Suppes (1966) acknowleclce* thar teaching oatarial in 
CAI i» hated on the rationale of prograramed inotruction. To be 
aura, many programwer s arc very lax in progrn.i design and raly on 
testing to keep those individuals, whom wa may consider to be 
failures of the program, working on additional inati rial until mastery# 
Generally there is agreement that the teaching eiemonto are supposed 
to follow good programming principles. Ideally the experiences 
given individually are arranged in a gradual progression. In the 
case of individualisation, the effort is to uniquely tailor the 
particular progression to the individual to accomodate his learning 
rate or his past experience. Individual teaching items, when func- 
tioning as teaching items, are expected to require appropriate 
behavior before the student reaches a correct answer; thus a low 
b3sck~out ratio (Holland, 1967) is required, And, if functioning 
as teaching items, they must be able to elicit the behavior to be 
learned; thus they must have a low error rate. The teaching item 
does not trap the student into errors or diagnose his difficulties, 
rather it evokes the desired behavior so that it may be reinforced 
and established. But individualization requires another type of 
item. It requires test items which serve a diagnostic function. 

Such items serve to differentially predict. They are designed to 
recommend different things for different individuals. Considera- 
tions in test design should be brought to bear on the design of 
diagnostic material for individualization. First, to be useful as 
a diagnostic item, an item must discriminate among individuals. They 
must perform differently on it. Some must answer correctly; others 






muit b« in arror. A low orror rata Item doet not dif f erentiata 
individuala. Thu« a good diagnostic item meats critaria incompatible 
with those mat by a good teaching item. There is, then, an incom - 
psbibil 1 t y between teaching items and diagnostic items, or at least 
there is an incompatibility between teaching and diagnostic functions. 

To be useful as a diagnostic test, a test must have validity 
and reliability. Of special importance to us is tha relationship 
bstween reliability and test length. In general, the shorter the 
test, the poorer its reliability ' and validity. 

A test enabling one to make a good decision normally requires 
a reasonable number of items. This problem is openly recognised 
in tha development of IPI. Lindvall and Cox (1969), writing place- 
ment tests in IPI note that they require five to ten items for each 
bfr'havlorfll ohjecr^vr. Often, especially In CAT, a heavy predictive 
burden is placed on a single multiple choice item. Consider an item 
from the Stanford CAI reading program (Atkinson, 1968) i 

In an item presented by Atkinson (1968) as a typical one from 
the Stanford CAI reading program the child is shown the letter "r" 
to the left of an empty cell, and tha letters "an” above the cell, 
and four alternative words listed below ("rat," "bat," "fan," "ran"). 
The student*s response is to touch one of the words. If the correct 
word is touched, the next mainline item is presented. If an in- 
correct alternative is touched, an item is presented which requires 
either choosing the appropriate final consonant (if "rat" was 
touched) or the appropriate initial consonant (if "fan" was touched) 
or each of the corrective items in turn (if "bat" was touched) . 



After the corrective item or iteraa t'.ie orislnel mainline item is 
repeated . 

In its diagnostic function, the tneinlinc item which initiates 
the branching has severe liraitationa ao a f our-al tornut ive item. 

There is a twenty-* ive per cent opportunity to be correct by chance, 
and each alternative provides a different course of action. The 
reliability of aucb an item (though nowhere stated) must be low. 

But the conacquenco ia email alooj the student receives one or two 
items and then repeata the missed item. This brings us to the other 
component of the dilemma of individualisation '“•** the aiae of the 
consequence. The sise of the declnion so far as the student is 
concerned may vary greatly. How many items must a student do as 
a function of failing the diagnostic unit? or how much time must 
ha spend? In traditional testing, consequences are often large; 
a child is given an intelligence test to determine whether he should 
be in a school for the retarded, a student takes the college boards 
to determine whether he will profit from college. With such large 
decisions, it would be a waste to use even a single diagnostic item 
even one of perfect reliability to spare half the students only a 
single unnecessary teaching item. Moreover, single diagnostic 
items are seldom very reliable. Thus, the basic technological pro- 
blem to be worked out for individualisation is one of a type of 
cost efficiency for the student based on the cost in time of tne 
diagnostic material and the resulting savings in the decisions. 

A small decision, as frequently made in the constantly adjusting 
.sequence of a CAI program can not justify a lengthy diagnosis, but 
the short tests are unreliable and the estimate of cost efficiency 
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mutt take into account th® falee poaitivas and falac ncgativaa. 

The more finely grained the adjustment the worse the djl^mma, with 
single teat items being unreliable, and, even if they could be reli- 
able, requiring at least two-itera consequence to simply l^mak even. 

The present great stress on individualization takes considerably 
more student time in testing to find the teaching items they don't 
need, than the items themselves would have taken. In an IPI system, 
a student may spend as much as two-fifths of his time taking teats. 

With this much testing, the resqlta might be reliable (although reli- 
ability and validity information is seldom provided), but the con- 
sequences seem insufficient to justify so much testing (as compared, 
for example, with a onca-a-year placement teat). 

Individualisation , to escape this dilemma will require develop- 
ment of measures of cost effectiveness corrected for empirically de- 
termined reliabilities., It seems unlikely that many of the more well- 
known programs would fare well against opposite criteria of this type. 

But there is yet a more serious failure of individualization to 
live up to its press. Today, adjustment for individuality needs to 
produce greater diversity, rather than less. Programs branch on past 
achievement, on learning rate, on latency in answering items, but they 
do not branch on desired terminal behavior. Educational objectives 
are set by an educational establishment and create a homogeneous middle 
class. In Skinner's Walden Two , a visiting critic argues against 
behavioral design in society by objecting to the uniformity he imagines 
to be a natural consequence of such designs. He is answered by Walden 
TWO * 8 founder, Frazier, that creation of such uniformity would be bad 
behavioral engineering. It seems that there are few Fraziers in 



today’s world of behavioral technolofy. And the demands of Blacks, 
of radical students, and othcro are often for the purfjuit of 
different objectiven* To sell individualization as a panacea 
for these problems is a sham. Branching should bo on the basis of 
different desired outcomes rather than on different cnteiing 
behav ior . 
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